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REMARKS 

I. Intrpducrion 

In lespoiise to the Office Action dated April 24, 2003, no claims have been cancelled, 
amended or added. Oaims 1-57 remain in the application. Re-examination and re-consideration of 
the application, as amended, is requested. 

IL Prior Art Rejections 

A- Hie Office Action Rejections 

In paragiaphs (2)- (3) of the Office Action, claims 1, 20, and 39 were rejected under 35 
US-G §103 (a) as bemg unpatentable over Bayer et aL, Us. Patent No. 5^02,987 (Bayer) in view of 
Tsuchida et al., US. Patent No, 6,026,394 (Tsuchida). In paragraph (4) of the Office Action, claims 
1, 20, and 39 were rejected under 35 U.S,G §l03(a) as being unpatentable over Bhattacharya et aL, 
US, Patent No. 5,797,000 (Bhattacharya), In paiagiaph (5) of the Office Action, claims 2-3, 21-22, 
and 40-41 were rejected under 35 US.C S103(a) as being unpatentable over Bhattacharya as applied 
to claims 1, 20, and 39 in view of Mntz et al., US. Patent No. 5^22,235 (Hintz). In paragraph (6) of 
the Office Action, claims 4-6, 23-25, and 42-44 were lejeaed under 35 US.C §103(a) as being 
unpatentable over Bhattacharya as applied to claims 1, 20, and 39 and in view of Bordonaro et aL, 
US. Patent No< 5,307,485 (Bordonaro). In paragraphs (8)-(9) of the Office Action, claims 1, 20, and 
39 were rejected under 35 US,G §l02(e) as being anticipated by Gatth et al., US. Patent No. 
6,272,486 Bl (Garth). However, in paragraph (10) of the Office Action, claims 12-19, 31-38, and 
50-57 were indicated as being allowable if rewritten in independent form to include the base claim 
and any intervening claims. 

Applicants* attorney ackno^^dedges the indication of allowable claims, but respectfully 
traverse these rejections, 

B. App licants' Independen t Oaims 

Applicants' independent claims 1, 16 and 30 are directed to loading data into a data store 
connected to a computer. Independent daim 1 is representative and comprises the steps of: 
ideririfjir^ mexnory corjstiaints; 
identifying processing capabilities; and 

determining a number of load a^d sort processes to be started in parallel based on the identiGed 
memory constraints and processing capabilities. 
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C The Baygr Rgference 

Bayer describes a high flow^rate synchronizer/scheduler apparatus for a mudprocessor 
system during program run-time, which comprises a connfiction matrix for monitoring and detecting 
computational tasks '^ch are allowed for execution containing a task map and a network of nodes 
for distributing to the processors information or con:^uTauonal tasks detected to be enabled by the 
connection matrix. The network of nodes possesses the capability of decomposing information on a 
pack of allocated computational tasks into messages of finer sub-packs to be sent toward the 
processors, as well as the capability of unifying packs of information on termination of 
computational tasks into a more comprehensive pack. Amethod of performing the 
synchronization/scheduling in a multiprocessor system of this apparatus is also described. 

D. The Tnschida Reference 

Tsuchida describes a database management system for executing database operations in 
parallel by a pluraKiy of nodes and a qi:eiy processing method. The database management system 
contains a decision management node for deciding a distribution node for retrieving information so 
as to analyze a query received from an application program, generate a processing procedure for 
processing the query, and execute the process, and a join node for sorting, merging, and joining the 
information retrieved by the distribution node. When the query process is executed, the distribution 
node decided by the decision managenoent node retrieves the information to be processed and the 
join node decided by the decision management node also obtains the result for the query from the 
retrieved information. The query result is outputted from an output node and transferred to the 
application program. 

E. The Bhattacharya Reference 

Bhattacharya describes a method of performing a parallel join operation on a pair of 
relations Rl and R2 in a system containing P processors organized into Q clusters of P/ Q 
processors each. The system contains disk storage for each cbster, shared by the processors of that 
cluster, together with a shared intermediate memory (SIM) accessible by all processors. The relations 
Rl and R2 to be joined are first sorted on the join columrL The underlying domain of the join 
column is then partitioned into P ranges of equal size. Each range is further divided inio M 
subranges of progressively decreasing size to create MP tasks T.sub.m,p, the subranges of a given 
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lange being so sized relative to one another that the estimated completion time for task T-sub-map is 
a piedeiemuned fraction that of task T^ub.m-l,p. Tasks T^ub.m,p with larger time estimates are 
ass^ned (and the conesponding tuples shippec^ to the cluster to which processor p belongs, while 
tasks with smaller time estimates are assigned to the SIM, regarded as a universal cluster 

(cluster 0). The actual task-to-processor assignments are determined dynamically during the join 
phase in accordance with the dynamic longest processing time fiist (DLPl) algorithm. Each 
processor within a cbster picks its next task at any given decision point to be the one with the 
kigest time estimate which is owned by that cluster or by cluster 0, 

F. The Hintz Reference 

Hntz describes a reorganization method of DB2 data files e^loting parallel piocessii^ and 
asynchronous I/O to a great extent. It includes means to esrimate an optimum configuration of 
system resourceSj such as storage devices (DASD devices), memory, and CPUs, etc, dmir^ 
reorganizations. The method mainly consists of four components, (1) concurrent mdexing, (2) 
concurrent unloadii^ of data file partitions, (3) efficient reloading of DB2 data pages and DB2 space 
maps, i*nH (4) means to reduce access constraints to the DB2 recovery table. 

G. The Boidonaro Reference 

Bordonaro describes a system and method for merging a plundhy of sorted lists usir^ 
multiple processors having access to a cornmon memory in which N sorted lists which may exceed 
the capacity of the common memory are merged in a parallel errvinonment. Sorted lists from a 
storage device are loaded into common noemory and are divided into a number of tasks equal to the 
number of available processors.. Hie records assigned to each task are separately sorted, and used to 
form a single sorted list, A multi-processing environment takes advantage of its organization during 
the creation of the tasks, as well as during the actual sorting of the tasks. 

H The Gayth Reference 

Garth describes a method, apparatus, and article of manufacture for a computer- 
implemented building indexes system. Indexes are built for a database that is stored in a data 
storage device coupled to a computer. An amount of available memory is determined. An amotmt of 
memory for use in transmitting data between extraa, sort, and index build tasks is determined. 
Tten, a number of sort tasks to be used to build indexes is determined based on the determined 

-16- 

G&C30571279-US-01 

PAGE 2200 * RCVD AT 12/22/2003 5:14:1 2 PM [Eastern St« 



12-22-2003 02:25PM FROM-Gatas 4 Cooper LLP +13106418798 T-745 P. 023/030 F-794 



amount of available memoiy, the determined amount of memory for use in tnmsmitting data 
between tasks, and task memoiy requirements* 

L ^pKcants' Oaimed Invention Is Patentable Over The References 
Applicants' attorney respectfully submits that Applicants' claimed invention is patentable 
over the references. Specifically, Applicants' attorney asserts that the references do not teach or 
suggest the limitations recited in Applicants* independent claims 1, 20 and 39. 

With regard to the rejections of claims 1, 20 and 39 under 35 US.C §102(e) based on U5. 
Patent No. 6^72,486 Bl (Garth), the present application has been amended to claim continuation- 
in-pan status from US. Patent No. 6,272,486 Bl (Gaith), thereby eliminating the patent as a prior 
art reference. 

\iPith regard to the rejections based on Bayer and Tsuchida, the Office Action states the 
following: 

3, Claims 1, 20, and 39 are rejected under 35 US.C 103(a) as being 
unpatentable over Bayer et al. (US Pat 5,202,987) in view of Tsuchida et aL (US Pat 
6,026,394). . „ , 

Regarding claims 1, 20, and 39, Bayer et aL disclose a method of loading data 
into a data store connected to a computer, the method comprising the steps of: 

identifying merxiory constraints (coL 1, lines 13 - 15, memoiy and processors 
are operations bottleneck and col. 5, lines 52 - 56, meniory is constrained or limited 
through factors such as physical shaned storage, network access or processor 
distribution, and common memory space); 

identifying processing capabilities (coL 1, lines 17 - 27, synchronization 
activities are controlled by algortthm, -which depends on processing power and col. 5, 
lines 24-31 requires the nxjinber of processors and capabilities of each processor, 
which entail processing capabilities); and 

deteraaining a nurnber of load (coL 14, lines 25 - 33, loading capacity being 
part of task map) to be started in parallel based on the identified memory constraints 
and processing capabilities (col. 7, lines 9-1), 

Although Bayer et al. disclose the sore process being a mere tasks allocation 
to the processors (coL 1 , lines 44 - 50), Tsuchida et aL have nevertheless further 
detailed the sort feature, which includes the step of determining a number of sort 
processes (coL 8, lines 50-51 discbse the fact that the sorting process depends on 
the nirmber of node for join process. CoL 7, lines 54 - 57 show thai the number of 
join nodes for performing merge process can be determined. Hence, number of sort 
processes is a known quantitj^, 

Iherefore, it is considered obvious to one of ordinary skill in the art, at the 
time the invention was made, to combine the sorting feature shown by Tsuchida et 
al. to the invention of Bayer et aL so that sort processing time, which is a factor in 
load balancing processes can be determined as part of system chaiactetistics and 
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optimizauon purposes (coL 7, lines 58 - coL 8, line 35). Note that the sort steps 
shown by Tsuchida et al are also parallel processes as claimed in the application (fig. 
3, parallel pipeline operation). 

Applicants' attorney disagrees. The cited poruons of these references do not teach or 
suggest the limitation **detemiinir^ a number of load and sort processes to be started in parallel based 
on the iderrdfied meinoiy constraints and processing capabfliries." 

For example, the cited portions are set forth below; 

Baven CqL 1. lines 13-27 

Tie coordination of multiple operarions in shared memory multiprocessors 
often constitutes a substantial performance botdeneck. Process synchionizarion and 
scheduling are generally performed by software, and managed via shared memory 
Execution of parallel programs on a shared^ memory, speedup-oriented 
multiprocessor necessitates a means for synchronizing the activities of the mdrvidual 
processors* This necessity arises due to precedence constraints within algorithms: 
When one computation is dependent upon the result of other computations, it must 
not commence before they finish. In the general case, such constraints are projected 
onto an algorithm's parallel decon^sition, and reflected as precedence relations 
among its execution threads. 

Bayen Col- 5, lines 24-31 {^^^'?i]]y, ^4-44} 

In addition to a task map, the synchronizer/ schedxiler k supplied with the 
system configuration data. Tliis includes svch details as the number of processors, 
the capabilities of each processor (if processors are not a-piiori identical), etc. 

Given a set of enabled tasks, as well as processor availability data, the 
synchronizer/scheduler then performs scheduling of chose tasks. Any non- random 
scheduling policy must rely upon some heuristics: Even when task execution times 
are known in advance, findirjg an optimal schedule for a program represented as a 
dependency graph is an NP-complete problem* Most schedulmg heuristics are bases 
on the critical path method, and thereby bebng to the class of Hst scheduling 
policies; i-e,, policies that rely on a list of fixed task priorities. List scheduling can be 
supported by the inventive scheme described herein, by embedding task priorities in 
the task map load-module submitted to the synchronizer/scheduler. Whenever an 
allocation takes place, the allocated tasks are those which have highest priorities 
amongst the current selection of enabled tasks, 

Bayen _Col.JL4. lines 25-33 
Characterizing Parameters 

The pararxieters characterizing a specific synchronizer/ scheduler can now be 
summarized: 

Loading Capacity, 

The maximal size of a task map which can be loaded. Hiis parameter is 
expressed in terms of quantity of tasks, and/or in terms of quantity of dependei:cy 
connections. 
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Bayen Col 7- lines 9-11 

The nmltiprocessor atchitecmne is Uluscrated ia FIG. 1, As can be seen, the 
parallel operation coordination subsystem (syncliiomzer/scheduler 10) forms an 
appendage to a conventional configuration of a sliared-memory 12 and processors 
14, 

Tsuchida: Col 8. lines 50-51 

The slot sorting process is set so as to be executed by the nodes for join 
process, 

Tsuchida: C ol 7, lines 54-57 

Next, the method for deciding the number of join nodes for perf oraiing the 
N-way merge process will be explained with reference to FIG. 7. FIG._7 is a 
schematic view for explainii^ the decision method for the number of join nodes. 

Tsuchida: Col 7. line_58_^col. 8. line 35 

In FIG. 7, it is assumed that the data retrieval/distribution process is 
ejcecuted In the nodes # 1 to # 8 and the processing time in each node is the one 
shown at each of the numbers 300 to 305. In this example, the processing rime 304 
in the node # 5 is the maximum processing time. The slot sorting processing time 
can be driven from the number of nodes for join process N, predetermined system 
characteristics (CPU performance, disk unit performance, etc.), and database 
operation method. The perfoimance characteristic (processing time Es) of the slot 
sorting process can be obtained generally from the following expression- 

Es-a/N+b'^N+c(l) 

The N-Tvay merge processing time (pm) and join processing time ^j) also 
can be obtained from the following expressions. 
Em-d/N-l^'^N+f (2) 
Ej-g/N+h*N+i(3) 

^wiere, symbok a, <i and g indicate constants which are decided from system 
characteristics such as the nxunber of rows, the number of pages, each operation unit 
time, and output time. Symbols b, e, and h are constants which are decided from 
system characteristics such as the communication time, and c, f , and i are constants 
\^^uch are decided from the other system characteristics. 

According to this embodiment, to maximize the effect of the pipeline 
process, the number of nodes for join process is obtained as the nimober of ass^ned 
join nodes 350 so that the performance characteristic Es of the slot sorting process 
becomes equal to the maximum processing time 304. When the nmnber of assigned 
join nodes 350 is detemuned, the N- way merge processii^ time 320 and join 
processing time 330 can be estimated from the equations (2) and (3), The total of 
these processing times is the total processing rime for a query. By deciding the 
number of join nodes in this manner and merging die data distributed in the data 
retrieval/distribution process successively and processing them simultaneously, the 
total processing rime (response time from querying to output) can be shortened. 
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The descriptions set forth above do not teach or suggest the liimtation "determirung a 
nximber of load and sort processes to be started in parallel based on the identified memoiy constraints 
and processing capabilities " 

Instead, Bayer is directed to the scheduling of synchronized tasks, but tasks are assigned to 
processors based on availabilitjr, wherein a processor is allocated a new task imm edia t ely after it 
terminates the previous one. See, e.g., coL 15, lines 1-25, Moreover, the "Loading Gapacit/ 
referred to above as a ''Qiaraaerizii^ Parameter," relates to the maxxmal size of the task map, 
wherein the task map is a data structure that identifies dependencies between tasks being performed, 
and IS used as indicated to assign tasks to processors based on availability. 

In addition, Tsiachida is directed a parallel processing database management system, wherein 
the configuration of the nodes, Le., processes, Is fixed. See, e.g.> coL 2, line 59 - coL 3, line 49. 
Ivloreover, a decision means determines which (already started) nodes are to be used to perform the 
query in order to minimize the expected processing time. 

As a result, neither of the Bayer or Tsuchida references teach or suggest "determinii^ a 
number of load and son processes to be started m parallel based on the identified memory constraints 
and processing capabilities " Consequently, it carmot be said that the combination of Bayer and 
Tsuchida teaches or si^ests, or renders obvious, the Applicant's independent claims. 

With regard to the rejections based on Bhattacharya, the Office Action states the following: 

4. Qaims 1, 20, and 39 are rejected under 35 IXS.C 103(a) as being 
unpatentable over Bhattacharya et aL (US Pat 5,797,000) . 

As per claims 1, 20, and 39, Bhattachary et aL disclose a method of loading 
data into a data store connected to a conopurer, the method comprising the steps of: 

identifying memory constraints (coL 9, lines 6-7, memory becomes a 
constraint as its capacity is a contributing factor and is limited); 

identifying processing capabilities (fig. 1, number of processors p, coL 4, line 
41- coL 5, line 8, each processor is assigned with a specific number of tasks, hence 
indicating each limited capabilit)^ ; and 

determining a number of load (coL 3, lines 1 - 3, join colimm domain and 
tuples are the bad, which obviously much be known in order for them to be 
partitioned and transferred among the cluster, col. 3, lines 7-18), and sort processes 
(coL 2, line 62 - coL 3, line 6 disdose various method of parallel sort process in 
which merge join is orxe example. Since the actual tasks assigned to the processors 
are determined during the join phase, which is part of the sort process as shown 
above, number of sort processes are hence inherendy determined as well) to be 
started in parallel based on the identified memory constraints and processing 
capabilities (coL 1 , lines 24 - 28, parallel tasks based on processing capabiliries: coL 4, 
line 64 - col, 5, line 8, parallel sort processing: col. 2, lines 66 - coL 3, line 6). 
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Applicants* attorney disagrees. The ciied pordons of the reference do not teach or su^st 
the limitations "determining a number of load and sort processes to be started in parallel based on the 
identified memory constraints and processing capabiliries." 

For example, the cited portions are set forth below. 

Bbattacharva: Col, 9. lines 6-7 fa mm1Vy^17) 

Each processor 104 of the system 100 is allotted an equal portion 1/P of the 
memory capacity of universal cluster 108. In the initial portion of the transfer phase, 
for each processor p (104) of the system 100, the tasks T-snbjn,p corresponding to 
that processor and residing on a pardcular cluster 102 are transferred from that 
cluster to the universal chister 108, beginning with the task T.sub,M,p having the 
smallest estimated completion time and progressing in order of increasing task size 
(i.e„ decreasing n^, until the allotted portion 1/P is filled (seep 532). The remaining 
tasks T.sub.m,p for each processor p (104) are transferred to the cluster 102 owning 
the processor, unless they are already resident there (step 534). 

Bhattacharva: Col. 4. line 41 - coL 5, line 8 

Referring to FIG. 1, a multiprocessor system 100 incorporating the present 
invention includes P processors 104 organized into Q equal-size clusters 102, each 
cluster containing P/ Q processors. Each processor 104 may be either a uniprocessor 
or a complex of tighdy coupled processors (not separately shown) that, for the 
purposes of task assignment, are regarded as a single processor. Each cluster 102 also 
mcludes one or more direct access storage devices (DASD) 106, wbich are magnetic 
disk drives in the system 100 shown. Each processor 104 within a cluster 102 can 
access any storage device 106 in the same cluster, but carmot access any storage 
device in any other cluster 102. Processors 104 are interconnected to one another as 
well as to a single intermediate memory (SIM) 108, to which each processor has 
access. SIM 108 is also referred to herein as lie universal cluster, or cluster 0, In 
addition to the memory 108 and storage devices 106 shown, each processor 104 also 
has its own main memory (not separately shown). In the case of a processor 104 
comprising a rightly coupled processor complex, such main memory would be 
shared by the processors of the complex. The elements shown in FIG. 1 are 
conventional m the arc, as are the intercormections between these elements. 

Processors 104 are used for the concurrent parallel execution of tasks making 
up database queries, as descrfced below. A query may originate ehher from one of 
the processors 104 or from a separate front-end query processor as described in the 
concurrently filed application of T. Borden et aL, Ser. No. 08/ 148,091, now US, Pat. 
No. 5,495,606. As further described in that application, within each cluster 102 the 
query splitting and scheduling steps described below maybe performed by an 
additional processor or processors (not shown) similar to processors 104; such 
additional processors would not be counted among the P/Q processors 104 per 
complex 102 to vMch tasks are ass^ed. 

Bhattacharya: CoL 3. lines 1-3 (acaially rnl 9^ Un p 66 - col. 3, line 6) 
In a parallel sort merge join, the relations to be joined are first sorted, in 
parallel, within their clusters 102 (FIG. 1). In a naive parallel sort merge join» the 
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underlying join column domain m%ht be pardtbned into P ranges of equal size, and 
the tuples transferred accordingly among the clusiers 102, However, given a 
nonumf orni distribution of tuples across the underlying domain^ there is no 
guarantee that the amount of join phase -work wSi be equal 

Bhattacharya: Col. 3. lines 7-18 (acmally lines 7-24^ 
In accordance with the present invention, each of the P ranges Is further 
divided into a relatively small number M of components, creating MP tasks 
T-sub.m,p in all. Hiese components intentionally have nonequal task time estiimtes. 
For example, a reasonable approach would be to partition the tasks so that the 
estimated completion time of a task T^ub.nijp is half that of the previous task 
T.sub,njrl,p. Assuming that the quadratic output term dominates the task time 
estimates, this can be done by partitioning the tasks in such a maimer that die extent 
of the range of a given task T.sub,m,p (to which the number of tuples in the task is 
roughly proportional) is l/,sqroot,2 times the number of tuples in task T.sub.m-l,p- 
FIGS. lOA and lOB show an example of such a paitirioning. FIG. lOA shows 
estimated task times as a function of m and p, and FIG, lOB shows actual task times, 
also as a function of m and p. The latcer may be different from the former, and wiD 
not be known untfli the join phase, ^v^n the casks are actually performed. 

Bhattachaiya: CoL l^lines 24-28 

This invention relates generally to a method of performing a parallel query in 
a multiprocessor environment and, more particularly, to a method for performing 
such a query with load balancing in an environment with shared disk clusters, shared 
intermediate memory or both. 

The descriptions set forth above do not teach or suggest the limitation "determining a 
number of load and sort processes to be started in parallel based on the identified meinory constraints 
and processir^ capabilities " 

Instead, Bhattacharya is directed to a parallel join operation, wherein tasks are assigned to 
processors based on the partitioning of the domain of the join column into P ranges and the 
partitioning of each range into M subranges to create MP tasks. In this context, P is based on the 
number of processors and M is based on the underlying domain, e.g., each subrange has an extent in 

the underiying column domain that isl/y/l that of the precedir^ subrange, and the subranges of a 
given range being so sized relath^e to one another, such that the estimated completion time for task 
Ti\p is a predetenrjined fraction that of task T^^^. In Bhattacharya, tasks T^ with larger time 
estimates are assigned to the cluster to which processor P belongs, while tasks with smaller time 
estimates are ass^ned to a universal cluster (e.g., cluster 0). The actual task-to-proccssor 
assignments are determined dynamically during the join phase in accordance with the dynamic 
bngest processing time first (DLPT) algorithm- Each processor within a cluster picks its next task 
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at any given decision point to be the one with the largest rime estimate which is owned by that 
cluster or by cluster 0, 

As a resuk, Bhattacharya does not teach or surest the limitations "determining a number of 
load and sort processes to be started in parallel based on the Identified memory constraints and 
processing capabilities.** Consequently, it cannot be said that Bhattacharya rendeis the Applicants' 
independent claims obvious. 

Hntz and Bordonaro £aul to overcome the deficiencies of Bhattacharya. Recall that Hmtz 
was cited only against dependent claims 2-3, 21-22 and 40-41, while Bonlonaro was cited only 
against dependent claims 4-6^ 23-25 and 42-44. Moreover, Mntz was cited only for determining a 
number of build processes based on the number of son processes, and for teaching that the number 
of sort processes does not exceed a number of indexes to be built, wiiile Bordonaro was cited only 
for leaching that the number of load processes does not exceed a number of partitions to be loaded, 
and that the load and sort processes directly dependent on memory constraints. None of these 
teachings are relevant to the limitations of Applicants' Independent ckims. 

Thus, Applicants submit that independent claims 1, 20 and 39 are allowable over the 
references. Further, dependent claims 2-19, 21-38 and 40-57 are submitted to be allowable over the 
references in the same manner, because they are dependent on independent claims 1 and 12, 
respectively, and thus contain all the limitations of independent ckims 1 and 12, In addition, 
dependent claims 4-9, 11-25 and 27-44 recite additional novel elements not shown by the references. 

in. Conclusion 

In view of the above, it is submitted that this application is now in good order for allowance 
and such albwance is respectfully solicited. 
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Should the Examiner believe minor matteis still lemain that can be resolved In a telephone 
interview, the Examiner is tuged to call Applicants' undersigned attorney. 

Respectfully submitted, 

GATES &:CXX)PER LLP 
Attorneys for AppHcants 



Howard Hughes Center 

6701 Gsnter DiTve West, Suite 1050 

Los Angeles, Galifomia 90045 

(310)641-8797 



Date: Tuly24.2003 By: , , 

Nanle: C&oige H. Gates 
Reg. No.! 33^00 
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